Can Observational Data Replace Randomized Trials?

نویسندگان

  • Paul McGale
  • David Cutter
  • Sarah C Darby
  • Katherine E Henson
  • Reshma Jagsi
  • Carolyn W Taylor
چکیده

TO THE EDITOR: The increasing complexity and cost of conducting randomized trials have stimulated interest in using observational data sets to evaluate cancer treatments. Determining the causal effect of treatments from observational data is, however, challenging because more aggressive treatments are selectively prescribed for patients with adverse disease characteristics or favorable comorbidity profiles. Associations may, therefore, arise between treatments and outcomes that are the result of confounding and are not causal. Relatively little is known about the extent of such confounding or the degree to which it can be removed through stratification by prognostic variables. Breast cancer is one of the commonest conditions for which radiotherapy is prescribed. We have therefore used it to examine this issue. We analyzed data on women registered between 1990 and 2008 in the SEER public-use data set. Women were excluded if they were younger than 20 or older than 80 years when diagnosed, had previous cancer, unknown cancer laterality, bilateral cancer, or unknown radiotherapy status. Each woman entered the study on the date of her breast cancer diagnosis and left on the earliest of the following events: death, loss to follow-up, turning age 85 years, or January 1, 2009. Two analyses were conducted. In the first, deaths and person-years were stratified by five basic variables; the second stratification also included all available prognostic variables. Mortality ratios were estimated by maximum likelihood using Poisson regression. Calculations were performed using STATAversion 12 (STATA, College Station, TX). Information was also collated from the Early Breast Cancer Trialists’ Collaborative Group (EBCTCG) meta-analyses of randomized trials of radiotherapy versus not. Analyses were stratified by trial, individual follow-up year, age at randomization, and nodal status. After breast-conserving surgery, with only basic variables in the stratification, radiotherapy was associated with reduced mortality for all the causes examined (Appendix Table A1, online only). Stratifying for all available prognostic variables changed the estimates, but all remained significantly below one. Notably, the rate ratio for mortality from all causes except breast cancer (0.69) was lower than that for breast cancer (0.74). After mastectomy in node-positive disease, with only basic variables in the stratification, radiotherapy was associated with increased breast cancer mortality and all-cause mortality, and decreased mortality from all causes except breast cancer. Stratifying for prognostic variables changed the death rate ratios for breast cancer from 1.35 to 0.89 and all causes of death from 1.21 to 0.85, but the rate ratio for mortality from all causes except breast cancer (0.74) was still lower than that for breast cancer (0.89). Estimates of the effects of radiotherapy in the EBCTCG meta-analyses of randomized trials were then compared with the corresponding death rate ratios in the SEER data stratified by all available variables (basic and prognostic; Fig 1). After breastconserving surgery, the breast cancer death rate ratio in the EBCTCG data was 0.83 for all women and did not differ significantly between pN0 (node-negative disease) and pN1 (node-positive disease; P5 .76), whereas in the SEER data the corresponding death rate ratio for all women was lower (0.74 v 0.83; P 5 .04), and differed significantly between pN0 and pN1 (0.84 v 0.73; P 5 .008). After mastectomy, the breast cancer death rate ratio in the EBCTCG data was 0.85, similar to that after breast-conserving surgery, and it did not differ significantly according to the number of positive nodes (P for heterogeneity 5 .53). In contrast, in the SEER data, there was substantial heterogeneity in the breast cancer death rate ratios according to the number of positive nodes (P for heterogeneity , .001). In women with one to three positive nodes, postmastectomy radiotherapy was associated with significantly increased breast cancer mortality in the SEER data (1.10; 95%CI, 1.02 to 1.18) and significantly decreased breast cancer mortality in the EBCTCG data (0.80; 95% CI, 0.67 to 0.95). For mortality from all causes except breast cancer, there were also major qualitative differences between the EBCTCG and SEER data. In the EBCTCGdata, radiotherapywas associatedwith significantly higher rates of mortality from all causes except breast cancer, including from heart disease and from lung cancer. In the SEER data, radiotherapy was associated with significantly lower rates of mortality from all causes except breast cancer, including from heart disease. SEER is one of the largest, most detailed data sets. If we had used these SEER analyses to draw conclusions about the causal effects of radiotherapy, we would have concluded that radiotherapy after breastconserving surgery is more effective in node-positive than in nodenegative disease, and that radiotherapy after mastectomy in women with one to three positive nodes causes death from breast cancer. We would have also concluded that radiotherapy prevents mortality from all causes except breast cancer, including from heart disease and from accidents and violence (Appendix Table A1). These results contradict those of the randomized trials. We conclude, as have others, that nonrandomized comparisons are liable to provide misleading estimates of treatment effects. Therefore, they need careful justification every time they are used.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Mortality reduction by vitamin D receptor activation in end-stage renal disease: a commentary on the robustness of current data.

BACKGROUND Debate exists about assumed mortality effects of the use of vitamin D receptor activators (VDRA) in haemodialysis patients. METHODS In the absence of randomized controlled trials (RCTs), current knowledge comes from several large observational studies that examined the association between the use of VDRA and mortality. In these trials, modern but complicated statistical analysis ha...

متن کامل

Comparison of effects in randomized controlled trials with observational studies in digestive surgery.

OBJECTIVES To compare the results of randomized controlled trials versus observational studies in meta-analyses of digestive surgical topics. SUMMARY BACKGROUND DATA While randomized controlled trials have been recognized as providing the highest standard of evidence, claims have been made that observational studies may overestimate treatment benefits. This debate has recently been renewed, p...

متن کامل

Refractory iron deficiency anemia and Helicobacter Pylori Infection in pediatrics: A review

Background Since the discovery of Helicobacter pylori, several clinical reports have demonstrated that H. Pylori infection has emerged as a new cause of refractory iron stores in children. We carried out a systematic literature review to primarily evaluate the existing evidence on the association between childhood H. Pylori infection and iron deficiency anemia (IDA) and secondly, to investigat...

متن کامل

A comparison of observational studies and randomized, controlled trials

BACKGROUND For many years it has been claimed that observational studies find stronger treatment effects than randomized, controlled trials. We compared the results of observational studies with those of randomized, controlled trials. METHODS We searched the Abridged Index Medicus and Cochrane data bases to identify observational studies reported between 1985 and 1998 that compared two or mor...

متن کامل

Observational studies, clinical trials, and the women's health initiative.

The complementary roles fulfilled by observational studies and randomized controlled trials in the population science research agenda is illustrated using results from the Women's Health Initiative (WHI). Comparative and joint analyses of clinical trial and observational study data can enhance observational study design and analysis choices, and can augment randomized trial implications. These ...

متن کامل

Efficacy and safety of inhaler steroids in COPD patients: Systematic review and meta-analysis of randomized placebo-controlled trials

Background: Chronic obstructive pulmonary disease (COPD) is a major health dilemma and cause of morbidity and mortality in either industrialized or developing countries and inhaled corticosteroids are widely used worldwide in these patients. In this systematic review, we aimed to analyze the effectiveness of these gents compared to placebo. Methods: Pubmed and Google Scholar literature search ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Journal of clinical oncology : official journal of the American Society of Clinical Oncology

دوره 34 27  شماره 

صفحات  -

تاریخ انتشار 2016